Papers with context-aware NMT
When a Good Translation is Wrong in Context: Context-Aware Machine Translation Improves on Deixis, Ellipsis, and Lexical Cohesion (P19-1)
Copied to clipboard
| Challenge: | et al., 2018: translation errors due to the lack of extra-sentential context are becoming more and more noticeable among otherwise adequate translations. |
| Approach: | They propose a context-aware translation model that uses sentence-level data to identify inconsistencies . standard metrics are not sensitive to improvements in consistency in document-level translations . |
| Outcome: | The proposed model shows major gains over baseline without sacrificing performance . standard metrics are not sensitive to improvements in document-level translations . |
Breaking the Corpus Bottleneck for Context-Aware Neural Machine Translation with Cross-Task Pre-training (2021.acl-long)
Copied to clipboard
| Challenge: | Context-aware neural machine translation (NMT) remains challenging due to the lack of large-scale document-level parallel corpora. |
| Approach: | They propose to use large-scale parallel datasets and source-side monolingual documents to improve context-aware neural machine translation. |
| Outcome: | The proposed model can be used to translate both sentences and documents on four translation tasks. |
Selective Attention for Context-aware Neural Machine Translation (N19-1)
Copied to clipboard
| Challenge: | Recent work in context-aware NMT considers only a few previous sentences as context . current systems fail to achieve fluent, good quality translation for a full document . |
| Approach: | They propose a top-down approach to hierarchical attention for context-aware NMT which uses sparse attention to selectively focus on relevant sentences in the document context. |
| Outcome: | The proposed approach outperforms context-agnostic baselines and context-based baselines on English-German datasets. |
ContraCAT: Contrastive Coreference Analytical Templates for Machine Translation (2020.coling-main)
Copied to clipboard
| Challenge: | Recent high scores on pronoun translation suggest current approaches work well . et al., 2018: are context-aware nmt models learning this task? |
| Approach: | They propose a test set to assess the ability to handle specific steps for pronoun translation . they propose heuristics that break down when translations require real reasoning . |
| Outcome: | The proposed model can model complex inferences required for translation of english into german . it shows that current approaches are not able to model all of this information well . |